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Abstract 


Three recent targenachie ietinentdt studies have ‘built on a data base 
established through several correlational studies of teaching ‘effectiveness “ta 
elemantary schools. These three studies have in common a treatment that 
AS several routine teaching tasks and suggests some principles and : 
techniques for Ketectively fulfilling those tasks. All three studies yielded 
results indicating that ne treatment teachers did use many of the behaviors 
suggested to them and their students had higher adjusted achievement scores. 
In two of the tien, the process-product correlations suported earlier work. 
In this article, the three studies are reviewed and suggestions ace made about 


future experimental studies of teaching effectiveness. Those suggestions are 


organized around the topics of creating treatments that maximize the chances 5 


for ecologically valid results, and of designing studies and choosing measures 
that allow as much experimental control and monitoring of the natural setting 


as possible. 
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During the last ten venta, there has been much research that 
systematically relates teaching behaviors and classroom characteristics to ; 
student learning. There was once pervagive pessinisn regarding the practical 
efficacy of research on teaching effectiveness, and even widespread doubt that 
teachers have any important effects on students or that ing iaachat effects 

. could be systematically documented (e.g., Heath & Nielson, 1974). However, 

_ recent reviewers agree that a knowledge base has developed, and a cohesive 
(although perhaps not tneliates) picture can be drawy of “effective teaching,” 

at least for educational settings and outcomes that have been studied most 

intensively (Borich, 1977;' Brophy, in press; Brophy & Evertson, 1976; Good, 

19795 Good, Biddle, & Brophy, 1975; Rosenshine, 1976; Medley,- Note 1). 

Most of the work discussed in these references has been cuneelaetonals” 
However, there have recently appeared ap large-scale classroom-based 
experimental studies of eaaahiae effectiveness in the elementary grades’ 
(Anderson, Evertson, & Brophy, 1979; Good & Grouws, in press; Program on _ 
Teaching Effectiveness, Note 2). ‘These th studies represent an important 
set of related findings and an approach noe on snacises that adds to 
and extends the existing large body of correlational process-outcome studies. 

The purpose of this article is to discuss, the application of experimental 
‘design to the study of classrooms. Three major studies completed at the 
elementary level are reviewed, ! and recommendations for future work are 
based on them and jchwbvagdveess 
Correlational Studies of Teaching Effectiveness 

The three experimental studies grew out of a knowledge base generated by 
several years gf research that can be characterized in these ways: 

1) Data were collected in classrooms where teachers and students were 


’ 


moving through their typical routines, without intervention by the researcher. 
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That is, the studies were naturalistic, and the observers and investigators 
did not play’ important roles in determining classroom processes: ‘Therefore, 
the data related natural occurrences throughout the year to he outcomes of 
interest, usually student iueesthe as measured oa achievement tests. In order 
to get as accurate a picture as somathln, the data were collected over several 
observations. Because of this focus on natural occurrences, the relationships 
between Singeeice processes and student outcomes were correlational. 

2) Most of the variables used to describe process-outcome relationships 
represented “typical” activities and tasks of elementary school’ teaching. 


Rather than focusing on special or new curricula, instructional programs, or 


. 


organizational patterns, the studies focused on common teaching activities 


. 


that occur in a variety of settingss Examples of these are: arranging 


‘students for instruction, questioning students and providing feedback to their 


answers, allocation of time, maintenance of order and monitoring of student 
behavior, providing for clagsroom routines and procedures, presenting 
intotwatien; and assigning work to students. 

_ 3) The purpose of most of the studies was to describe “effective. 
teaching,” with "effective" defined as vantous criteria, usually student 
achievement in the basic skill areas. Therefore, the purpose was not ais to 


describe classroom processes, but to learn about relationships between those 


“processes and the outcome of interest. ‘Such research has been called 


*“improvement-oriented," implying a practical concern with benefiting the 


educational process (Koehler, Note 4). Because of this goal, researchers 
conducting studies of teaching effectiveness have typically been concerned 
about the generalizability and application of shady findings to the “real 
world,” and have assumed that the first step in the development of effective 


teachers was to define effective teaching. 
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Therefore, coerelattueied studies have generally been perceived as an 
 smporteat step toward the longer-range goal of | understanding and prescribing 
raachivacstuiehcaw sltukttva for various ee In sith of chenielvaies 
these correlational studies have serious Limitations when one's. avowed purpose | 
is to improve educational practice. The mast carious limitations are these: a 
1. Because ehabeaiactendlice between teacher behaviors and student : 
outcomes are correlational, it cannot be determined that the teachers’ actions 
actually caused the eects Therefore, it would be inappropriate to. assume 
that all teacher behaviors that are highly correlated with student scitavemant 
actually preceded and caused that achievement. Statenents about what 
teachers Should do cannot. be derived directly from correlational data. 
, 2. Even if a causal relationship could be assumed (and in some i eanew, 1 
is very likely to exist), this does not mean that the information can be 
translated easily into improved practice by eaneiuie who do not already 
possess those "effective" skills. Therefore, an iepabeant research question 
is whether or not the identification of effective teaching behaviors can lead 
to improved instruction, and if so, what are the most. effective means of 


6 
providing the information. 


Experimental Studies of Teaching Effectiveness 


@ ' A 
The classroom—based experimental studies of teaching effectiveness are 


targetted to these questions about the causal nature of teacher effects and 
‘the utility of research-based descriptions of effective teaching. In such 
studies, teachers are encouraged to perform specific behaviors that have been 
associated with a desirable outcome, and data are boitacted on teachers' 
behaviors and associated effects on gtudents. Such an experimental paradigm 
was recommended be eowenelitce and Furst (1973), who described a cycle of 


research on teaching that developed from descriptive to correlational to 


, experimental studies. tikin con Snes also recommended that 
: resdarchers pursue experimental studies to verify earlier findings. 

The. experimental paradigm is certainly not new. to educational euanetis 
or even to research on teaching effectiveness. However, with the exceptions | 
described in the next section, most of the experiaental work has relied on 


laboratory-like settings or artificial. controls within elassroces in order re 


study a enall number of vattablaw: over a relatively short period of time. For ? 


example, teachers were given scripts to follow, so that different levels of 
questioning and feedback behavior gould be systematically varied and related 
to test scores for an ecology unit (Program on Teaching Effectiveness, 

Note 5). In such studies, the demands on teachers were. greatly reduced from 
those of the classroom, and the outcome measures were very spectfic to the 


tasks in the study. Therefore, any relationships between teaching behavior 


and outcome were not easily generalizable to classroom teachers, who must deal 


with many complex, simultaneous demands without the benefit’ of a script and 
limited responsibilities. , - 
Because of the highly controlled nature of such experiments, they, are 
often viewed as clean but trivial, at least when evaluated for their immediate 
pres practice. In order to conduct experiments that ‘verify 
earlier findings but also retain external validity (ise, "real-world" 
relevance), it has been necessary to aire duke the classroom and eondnk 


studies that blend experimental control with realistic interventions. 


Considerations for Experimental Design in Classroom Studies 


Much has been written about various ways of examining validity in an 
experiment. Campbell and Stanley's (1963) classic piece primarily emphasized 
internal validity--the degree to which one can isolate factors that contribute 


to a causal relationship. Bracht and Glass (1968) extended Campbell and 
= \ 
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psychological processes, and suggested that the experimenter should adapt 


Stanley’ s briefer atscuseton of external validity ie extent to which 
experimental results can be generalized beyond the experimental setting.) 

They described two important kinds of external validity: population validity 
(the alegten to which generalizability is limited to the population used in the 
experiment), ms ecological validity (the degree to which gaileralixability is 
limited to the setting used in the study).. They suggested several ways in 
which any experimental setting may contribute to effects beyond those caused 
by a treatment, such as Hawthorne effects, pretest and posttest sensitization, 


and novelty and disruption effects. In applying this concept to the study -~of 


teaching and Erase rOORe, one must ask if the act of “treating” any elements of 


the setting. changes the setting sufficiently to prevent generalization to 


ed 


other Glasetoond and teachers. That is, will the same treatment, outside of | a 


an experimental study, have the same. effects? 


Shulman (1970) suggested that educational researchers should also be 
concerned with “task validity" as another source of external validity. That 
ie, are the tasks (or mental operations) performed by subjects in an 
experiment like those utilized in the larger setting of interest? He expanded 
on the idea of eaiis validity by suggesting that researchers must find better 
ways to study and characterize learning envirginents, recognizing their 
inherent complexities. : a 

Snow (1974) reviewed earlier work and suggested that an additional 
concern should be that experiments be representative. He stated that the 


“biggest threat to external. validity may come when the experiment does not fit 


ke 
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the nature of the behavior being studied and, furthermore, does not include 
the means of discovering this fact." (p. 265) Snow drew heaviliy on the work : 


of Brunswik (1956), who emphasized the adaptive, active nature of | “0 


-74 0 


@ 


\ : . ’ 


methodology to fit this form of phenomenon rather than trying to examine it 


ehrough simpler methodologies hae isolate and decontextualize discrete 


behaviors. Snow suggested several ways in which representative and 


~~ 


quasi-representative. experiments could be conducted, including moving fato 


applied settings such as classroons, conducting intra-experiment observations 
to document actual processes, extending the life of vet and sampling 


several experimental effects, Many of Snow's suggestions were carried out in 


the clues studies reviewed ‘below, and in these respects, ‘they Peer Fron more 


traditional educational experiments. : 

Cook and Campbell (1876) discussed the design oa conduct of experimental 
studies in field settings. Although they focused on poy se drawn from 
Anguatn ial and ocgantybtdonal psychology, their _points a also very 
applicable ee research in schools. They refined the meaning of external 
validity to distinguish between generalizability of results to otha settings . 
and populations and “construct validity." The latter refers to the accuracy 
with which the a ies aschaniéas and | effects have been described. ‘That is, 


when a treatment /effect has been detected, what aspect of the treatment was 


Pe 


SPRADOUELD LSE In order” to assess construct validity, one must understand how 


the treatnent, /as viewed eh the experimenter, may be, confounded with ‘other. 


causal ee en As examples, they describe Hawthorne effects (increased 


F & 
‘productivity was felated to the extra concern and attention that came with 


rs 


. membership in the treatment groups) and experimenters’ expectancies 


communicated to treatment subjects that affect their responses. Such effects 


may ‘be difficult to separate from the content of the treatment*-the constructs 
‘ ; rs . : 4 ‘ ¥ 

that aré supposedly being examined in a controlled manner. 

Construct validity is an important concern in classroom research. As 


will be seen ‘in reviewing the threé studies, it is. often difficult to 


& 


‘ 7 s * ~ 


‘ 


establish what ‘aspects of the treatment content and pecairt most account for 
an overall treatment effect. uty aieattoua ee be resolved if one is to 
generalize about’ the effects ‘of the tevecnentt0 peat settings. 

| In summary, thinking about educational experiments since Campbell and 
Stanley (1963) has reflected increasing concern wichiactovaal validity 
(including construct validity) and a eaasgaleton chee’ natapal (Lee, - 
representative) settings often have to be utilized if there is to be 
generalizability. thik tupanas two difficult tasks on the experimenter. 
First, a greater eoncee than before about external validity does not reduce 
the need for internal validity, even though sxpavtieen tal eunkeal is more 
difficult to exert in “real-world” settings. Second, the experimenter must 
have an adequate understanding of the complexity of the natural setting in 

- order to select treatments that are relevant (ise, match the demands of that 
setting) and to select the potentially most important intervening variables to 
measure. In short, the ehuerinenter must balance rigor and relevance. 

‘Research in any field setting poses difficulties, and the classroom is no 
exception. At as given moment, cigs tance wae Be aware of and coordinate 
the activities of 20 to 35 students in order to move toward a variety of goals 
established by the teacher, the school administration, and society. Classroom 
‘ecology has been characterized as including multidimensionality, simultaneity \ 
of events, immodiacy of demands, unpredictability of interruptions, and a 
’ history that colors the participants' perceptions (Doyle, 1977). 

In spite of this eomplexity, cdassroom researchers’ have been able to 
identify several characteristics of effective teaching, especially in the 
prlwiey: acadea Cexes Brophy & Everton, 1976; Good, 1979; Medley, Note 1). 
The result of. such research has not been a list of discrete. teacher | 


competencies that can be considered in isolation from‘ one another. Instead, 


£2 
= ae 


\ 


te oe cr a * the effective teacher hag: beet portrayed as s orchesttating and; integrating ‘néay a | 


Big “ " ROY 


| dtacrete ‘oktl18." ‘That ts, an. “effective beachae: ‘does man many things wells For , 


‘ 4 * Poa “any” stpiy, correlational or experinental, to- ‘ofnticthuka. to knowledge about at | 
we ann’ oF, Gt Sing 23 , : . - : 


be, aieen 2 _elassroons, this. fact: at be recognized. "FAs : oh a a : - nae 


aa Mi 2 é . ‘s i cae a Ba, oe 


Given. the Incredible complexity. of. ‘ha eleborooe. and the many influences 


s eee ; < on’ ‘ite processes and outcones, the expetinente:' . “task of Sugaling rigor and i 


ore 


. as “gelevanee: an’ ‘a classroom-based atudy™ ts an especially difficult one. However, 


Suet ae Re 


; “gat! Bee > the most important eimilarity of the dives studies ‘reviewed below: is 2°counon, : a 
: hare “ a ~ pattern ‘of results that indicates high. payort. In each case, Providing 4 : | 

ne . es - teachers: with integrated research-based prinéiples of instruction preceded ' . 
e, : ys " oy ‘shanges in teacher behaviors (a ene desired “dtrectioa) and an increase in ae ” 
BS 6 es _atudent. achievenent. ‘The implication of these results is ehae a ‘classroom ‘ | a 


ay 7 2 r based, experinental approach ehet incorporates. several aspects of Anatruction foe 


Nog, 9 : - s - hokde Promise for the ® atudy of. teaching effectivences: in spite. of, ite ‘tnherent — ed 
PO eh gp aw” 

ee g slene ies eT Sa et Pate a oe 

‘aa a “i he sn Mh! : ‘i a ar 

era ae: ons pte ep ” : / Summaries of the Three Studies 

eee Bach of ‘the’ three, studies: included a. treatment sven to. one: “of two 

; 4 re o - experimental groups OF elenintsry Spaaelats< The treatment in’ each | case 

as contained aeveral. interretated suggestions about ‘instructions ALL . 


a vee) ,. @ 4 


: suggest {ons had a baste din "patliee esearch: or experience, and most ‘were taken. 


from Large-scale correlatiortal, studies of ‘teaching effectiveness. oo. 


a We 


‘ treatments focused on teaching methods, rather than currtculum content. 24 ta 


‘The Studiée were éonducted; in. natural classroom settings, with teachers 


' using: ‘the: activities; jedcantata,, and standard curricula that they, week: have ‘: aa 


*% 


; used ai the absence. of an ‘experinent. The experimenters aid nothing: during - 


1 Anat mctton ee to- observe on,.a- regular basis: to gather. data on. 


-@ oy 


treatment implementation. ,The data were collected ‘ad a large portion of the 4 
school year, using, complex coding instruments. oS aan iy ; 
the content of the three treatments differs because the studies focused } 
on different aapects of instruction. However, each may be said to reflect the 
general iar a dea of "direct instruction” as described _ Rosenshine (1976). 


That is, there was an emphasis in each treatment. on teacher leadership hoa 


2 


instruction, making sure that all students have adequate opportunities: to be 
exposed to instruction and to praccics basic skills. ~ 


Three important questions were. addressed by. the data in each. etudy?: 


_1l.e Did the teachers in ‘the treatment group use the suggestions given in. 
» the treatment? 7 oY . _ be we ty, me 
2. ‘ Were there differences in the lado: students who had 
treatment teachers and’ those who were tneteucted by control teachers? 
. 30 Were the process~out come sala within the studies those 


expected on the basis of earlier studies? | (That is, did the teacher behaviors 


. 


predict achievement as in earlier correlational. studies?) SRE? « 


. The Missouri Mathematics Effectiveness Project & SGood: & Grows, in press). 
Background. - A instructional model was deataned: for use by fourth-grade’ 


teachers in conducting mathematics lessons. Most of the Suggestions’ in the - 


. - 4 


‘math lesson model. were hanes on ‘an. earlier correlational etudy (Good” & Grouws 5 Siar 
- 1977), in which teachers who were’ consfetently more « ‘or less effective. in be: 


producing mathematics achievement were selected for observation. Data ‘about 


* 


their behavior were integrated with other recent research'on mathematics ~ ig 
“teaching, yielding the lesson model ‘that served as the treatment in the \ 


_ experimental study. 7 ety eee 4 


ee rereren atnemerteneeeeby 


hn ne merge een 


Treatment content. . The model was a’ ac syaren of instruction that focused on 
student’ comprehension, systematic pieparation of students for each stage of © 
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’ the lesson, distributed ‘practice ’ and cis and presentations by. the 
cuneneie Specifically, teachers were asked to conduct whole-class lesecne 
according to.a suggested routine. Regular times dor review. were. ‘echeduled, ) 7 

the development | portion of the lesson was emphasized,. and. eoachass were urged 

to pace the lesson'to maintain student attention and involvement and ‘to also - ‘a 

monitor student: PETE OTMANG Re Student accountability for. seatwork. and homework | 


Po a - .. was enphasized. Specific suggestions were made for accomplishing each nets 


* on oe Treatment administration. Treatment teachers attended a training, Se 
So session and - were given copies of the 45-page manual ARGUE: the. Aaaan model, zo 


which contained definitions, rationsles » and detailed descriptions of tesecn:’ 
components. Two weeks after the treatment began, the gaerigancted net again | <3 - 
with the treatment teachers to answer questions. There was n6Eurther ie 
training. . | 

dihietiay The ceuple included 40 volunteer. saathare fice 27 . 
. predominantly lower-SES schools in an urban district. All were fourth-grade 
‘teachers who taught math through a semidepartmentalized plan. . : 

‘ Design. Schools _were randomly assigned to experimental conditions after” 
| ‘being matched for SES-level. (Assignment was done by achools to prevent 
| teachers in the same school ‘from being assigned to different conditions, ‘and: 

‘therefore. possibly apreading treatment information’ te: the control classes.) 


The treatment group contained 21 teachers, and the control group (termed the 


“hs "delayed-treatment”. group). included 19 teachers. With a few exceptions, each 
teacher was observed six times. 
Re 7 Teachers in the delayed-treatment group were aware of the purpose of. the 


; atogy The experinenters encourag them to do their best by telling. them 
: that dal catncaitade teaching was: ander scrutiny, that their students! 


achievenent would be evaluated, and that after the study,, they ‘would receive _ = 


- ® 


feedback on their own teaching as well as the instructional model. — ; . 
(Therefore, their treatment was. to be delayed, but not denied to then, and” so 


they were not like typical control groups.) The experimenters reasoned that - 


creation of a strong Hawthorne. effect in both_groups ‘through encouragement and 


attention would enable them to pel if effects of treatment | content: added | 


to the effects ‘of enhanced motivation. Sisnies both groups of teachers were 
made to feel‘ accountable and were giv n: extra attention, but only the. 
. dmmediate-treatment teachers had received the lesson model when observations 
“were made. Delayed-treatnent teachers: were encouraged to teach as they | 


: normally did. 


Measures. The primary classroom process measures ‘were those -used in the 
earlier correlational study, atta a summary cheeklint used to estimate 
implementation of treatment behaviors. The students" math’ achievement wae _ | 
tested before and after the treatment period (October through January) by SRA 
wach subtests. In addition, a test ‘designed ae measure ‘the content covered by 

allt teachers was given in, January. - es 

Results: implementation 0 of i_treatnent. Analyses of observation data 

revealed that | the. treatment, was fairly well luplenented by most of the | 
dumaltatactaeatnant: teachers, _althougti there was ‘dss. smplenentation of the 
principles < on the cea dese poreions of ae lesson. ~ “, However, on all 
general iuplenentation measures, inmediate-treatment agate -were performing 
nee more” in line with the. lesson widet than delayed-treatment teachers. 

- The delayéd-treatment’ teachers reported, that. they had given more ‘thought: 


_ to teaching math that year, but they had not eignificantly altered their 


meguiae teaching practices. Ce. wer = 2 7 a. es | ‘ 
2 med . Results: effects on achievement. _The* aon the students: | the . , 
. a inmediate-treatment ‘group exceeded the. performance of the delayed-treat nt 
Pac ; . ; e  % . 
er ee wr ee 


. group ‘on all measures, in spite “ik the fact that the former group's: entering. 
scores were ‘significantly. lower than the latter group’ 8. The delayed- 
treatment group's evorabe percentile also ‘Tose. during the period of the study, } 
althougt the gains were not as large as the inmed{ate-treatment. en "ae —The 


gains of the delayed-treatment geen suggest that the tisurevaabae and - a 


“not gait’ as much as Gaeats whose teachers. had been eared: to: ‘the 


attention given to thei had beneficial effects: However, their acidente did 
5 4 instructional strategiesfin the lesson hii 


‘Resultet process-outcome relationships, Several components. of ‘the. . eG 
lesson model were correlated with residual gains. - There were significant ‘: ~ 
positive relationships with achievement : for use of review, assigning “homework, * | 
providing practice in mental computations, and requiring accountability for 
seatwork. _ Thery were near-significant positive results for suggestions about. - ee 
conducting seatwork. In addition, all of the general inplementation méasures . 
were correlated positively with achievement gatas. e . ‘ | | 

Conclusions. Significant increases in sau achievement. in nathenatice | 
were: related to teacher behaviors that were éppareatay influenced by ie 
treatment given to the- teacheter fit on 
The Stanford Experiment on. Teacher Effectiveness (Progren on ‘Teaching | -— ' 

ae 


: Effectiveness, Note aye - sy he ss ae ; - 


Source of treatment. The. treatment ‘in thid study was based ‘ ‘on. 125 


yarcahtne derived from four. correlational studies of teaching effectiveness: 


‘Brophy and Evertson (Note 6), McDonald and Elias APate 75: Soar (Note 8), are | 

Pe eRe Stallings and Kaskowitz (Note 9)s Each of these etudies had: in common a. focus: 
-on teacher and. atuselt behaviors in elementary area ae eei-ph-paar 

‘ ‘Feading achtevenent inpiuded as: one | e eriterta of effectiveness. The ¥. | 

a) 7 | . ‘ ; 

me ate in hd. Pe, Oe 


+ Care 


7 manual a week desc} Hibing i treatment for a ‘five-week ,period. One treatment 


' 
ot “as =| 


: control group ‘Te stved: no training. Bach week, treatgent Sencpers completed 


~~ ~semester, there/was a “refresher course” given to the treatment teachers, 


an investigators selected packets: at. significantly correlated with, waading cee 


achievement at the second. or thirf grade levels 
Treatment content. The resulting treatment was a five-part program 
including 22 recommendations in/ three broad areas: behavior ‘management and 


classroom discipline; instructional methods; and questioning and feedback 


-* strategies. Under the heading RB of peheyeor management, some suggestions were 


« yteg avoid target and, timing efrors ‘as discipline, and therefore ‘to rein ‘. 


“withit” 5 to° ‘establish a. Sy tem of ‘Procedures for students! personal needs; 
and to move around the ‘room to monitor student pabaytors Suggestions groupad 


ander instructional methods included minimizing direction giving and - 


* wietntstag time spent in brganizing for instruction and in instructing very 


small groups and individ als. The purpose was to maximize the total amount of 
“time that individual stpdents were under the direct supervision of the 
teacher. Many of the quggestions under questioning and feedback _ strategies 
distinguished between appropriate Eeacting practices for. ‘students who were 
«more or less acadenich lly oriented. The strategies discussed here. included — . 


re 
‘ 


responding to ineoires ct answers and adjusting atfficulty. leveis of public 
, Meatttonss, - ip 3 - .. ae 


Treateent admi tetration, arbchees in the treatment group recetbed one 


- group’ (minimum-trd semanty received he’ ‘watertata through the mail, while te a 


. 


“another group (maj nai-treatuent) teceived the same materials and’ ek 


‘attended a, twomhe r ‘in-service meting each” won +0 dtecuss the topsce The | - 


ct , : 
quizzes and quegtionnaires after réading the materials. During the spring | « 


during which the minimun-treatment ‘teachers, received written materials » and 
the maximal-treatment Seen were videotaped and given personal feedback. 


« pSubjects. “Included in tthe aes were 33 third-grade classesjn 24 | 


elementary. schools in two adjacent, school avait that were slightly | above 


the state “average SES level. All teachers. in the. study were volunteera who | 


had. been fold the full-design: arid rationale of the eeney before. abeesicie to, 


treatment groups. All teachers had at least four ros ‘of -teaching 


experience. In 29 of the 33. classes, there, was. also a, state program. being 


.. Implemented with an emphasis on. parent tnvol\ ement and individualization. 


n 


This is important to note, since some of the treatment teachers reported ‘that 
the suggestions made in the xepariwantad treatacut confitéted with the. . 
expectations of the state: program, dapecladiy regarding use of individualized 
and small-group instructional modes (Witman,, Note 10). . | = 
Design. There were three levels of ,teaching effectiveness treatment: 
maxinal, minimum, and control. In addition, there were two dexeds of . 


- participation eneent or ‘absent) in a parent-involvement program, ‘resulting 


| in a 2x 3 design wine five or six classes ‘in each cell. The groups were 


formed by seratitted-réhdon assignment ‘within two ‘districts, basi the mean 


class reading prétest scoreese _ Therefore, the treatment’ groups were. 


comparable in terms” ad entering achievement level of the students. ‘ict class | 


¥ 


was observed four times. before the: treatment period, five tines during the 


five weeks. of treatment. administration (November © through: December),. and seven 


times after. the treatment ‘had been ‘given. Each observation lasted a. fall 


1’ 
) 


day. 


-Measures. ane primary process measure was “the ‘Classroom Observation — 


January and May additional high inference ratings were taken. Students were 


O22 Be 


a Instrument “cai ninwe & Kaskowits, ‘Note 9) with ‘ome wodifications.— “During 


i ere constee regarding teaching style preferenc 28 


+ | 
__ tested in Septenber, January, and May on a variety of aptitude, achievement, 


and attitude measures. Teachers completed tests of verbal ELuency: and a 


ore the treatnent was 
ye , 4 ; 
given. . 


Results: implementation. In general, the two. ese cal de ure 


higher implementation scores than the control group; | , miniaum-treate ant * 


_ group's scores were higher ‘chan the maximal-treatment group's. On the overall - 


. implenentation measure, the difference. was significant . @ = .02); sdparate . 
analysis of three treatment components yielded less significant diff. rences, 
but the results still faborad the treatment | groups. ” When the separat 
oe of the areatment were examined, the treatment. groups. had 
significantly (p < +10) higher {nplementation scores than the patrol a group on 


five of 16 principles analyzed at the class level. (Results for other * 


variables were. not significant; however, trends in the expected directton were 
; . & \ 


found for five. of the remaining nine variables.) 


GE special interest was the relationship between implementation and ve 
ceactieny* peereee Saciees. of sa eas and sel f-ratings ‘of. . 
structuredness: ‘There were significant positive correlations for each of the 
teacher measures and implementation. Unfortunately, means ‘on ‘both teacher 


‘ . 


_ Measures were higher in the minimum-treatment group, despite =: ‘sandou 
assignment of classes to- treatment groups. When, the composite tnplenentation 
scores were adjusted doe “verbal fluency and précrearaent structuredness, the 
. main et tect of beatient on implement ation was no lonaee sigotticant 
@- 163). 

Results: student achievement. Analyses of student stuileemnnt- ab eh 
~ end of the school year revealed ’several interactions between the two ‘programs 


(the teacher effectiveness program discussed here, and the parent involvement. 


rY 


ey . . * 
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| program) and school district membership. The district effect was to reverse 
the order of the minimun and maximal peoups, but in 'aech inst Tie treatment 
groups had higher adjusted achievement on reading tests. Classes eeowiving: 
both tegen effectiveness trainihe and the parent-assisted program had the 
_ highest adjusted eending achievement of all groups. . 

Results: process-outcome relationships. When using the ‘composite , 
measures of implementation, there were consistent although not strong 
positive relationships with. adjusted. achievements However ‘only two ‘one of ~- 
nine correlations were significant at Pp < 205. ‘This pattern of positive . 
correlations was sive: avtdene: for vocabulary scores than other outcome . 

measureg, and more evident for the questioning and feedback principles than 


for the other two, parte of the treatment (Crawford & Stallings, Note 11). 


_ .Stayrook and Crawford (Note 12) report the ‘direction and strength of 


“correlations of the individual process variahles: with achievenent. “About half 
of mse correlations agreed in sign with. the original studies, pet only one 
variable out of 48 was significantly associated with Total Reading achievenent 


_at the level of p= .05, and it was ‘correlated in = dbdaaita. ‘direction 


expecteds 


Sieanavakt ete investigators noted that one Gieeieulty “20 evaluating their 
' results was that -many of the variables (especially those derived from the 
‘Brophy and: Evertson study) wete not adequately wsaviiced with their . : 
observational instrument. The lack of clear process-out Come relationships may 
be-a fuidtdon-ot this. | | | | 
acta tte: Generally, the expiciaaré fulfilled its cee aia Pore 
teachers in the treatment groups used the suggested behaviors more than 


teachers in ‘the. Sonteol groups, “and there was a la ta difference in 


“adjusted achievement favoring the treatment groups. However, the ~ 


- account. for improved Teargenes ate 


"use in reading lessons. 


" eriticism). 


“elytig’ on VELUNCERESS use sustaining. feedback (simplifying questions). after _ | a 
pee errors when aj propriate to the pAees and be’ specific ‘vben giving. 


' praise and criticien. 


process~outcome relationships do not strongly support the conclusion that the 
content of the treatment was most responsible for these changes in behaviors 


and outcomes. It is possible that simply participating. ina treatment program 


and focusing steentton on the goal of increased reading achievement could 
‘ ; 1s [ 


. eg 


The genes First-grade Reading Group Study (Anderson, Evertson, & Brophy 1979) 


ed of treatmen treatment was an instructional: ‘model that 


Mag information ‘bout emall-group ianauinane to steetrgtade ‘teachers to 


“The ee source of the treatment was Brophy ana 


: Ad 


Evertson (Note 6), from which several process~outcome relationships’ were 


derived. 


Development. Laboratory (1973), and Kounin (1970). 


Also used as sources were..Blank C397395 the Southwest Education 


a: 


Treatment content. -The treatment consisted of 22 principles of | re 


small-group instruction, organized. under two main headings: management of the - 


entire group, and responding to individual student's answers. Within each 


Mee a 


major heading, principles were organized by teacher tasks (eoge, getting and 


maintaining-attention, selecting ‘students to. answer questions, providing ibs r 


W . e 


feedback to incorrect answers and failures to respond, and giving praise and 


Examples of specific suggestions under Sheae: headings were: use 
a standard and. predictable signal to begin transitions; Strange the group £9 
facilitate teacher. monitoring and ‘minimize ‘student distraction; eat on 


students in érder around the circle rather than selecting’ them randomly or 


! 
Overall, the. treatment japhawixed naintaining ‘student 


attention, sequencing information clearly for students, and providing |. 


Anformation about the levant aspects of a question or answer. - 


nia 


Treatment administration, The Prana was. 5 described “ina short manual * 
that was given. to each teacher, ‘in the treatment groups,- The aipatinantace met . 
with the teachers to, explain the study and leave. the. booklet, and then. 
, feturned in about. a week to discuss the treatment and- answer questions». 
Contypl group teachers réceived “fo materials. ‘ | 
Subjects. ‘Twenty-seven female first-grade teachers “fa, nine schools 
‘agreed to ‘participate after the etudy was explained. to them, All taught 
students from otinanaty waneiin, Anglo neighborhoods, in a mecropolsfas 
echool district. The. teachers" experience ranged from one to 25 years. All , ae” 
teachers delivered a large part. of their reading instruction in small groups. 
Design, Before approsching the teachers,' three “groups of three schools 
were formed to represent similar SES levels. _ The three schools in each: SES ; 
level were randomly assigiied to treatment groups. Within a school, all - 
= participating teachers were in the same experimental. group, so that control 
| teachers did not have direct access to the treatment. Ten of the teachers 
served as the contol group; they had been told that the purpobe of the study | ' . 
was to learn what teaching practices related to reading achievement, gain, and 
they did not kno that another group was j receiving a treatment. Sevautéen 
teachers received the \treatment; ten were observed * ‘on a regular basis, while 
seven: were not obastyeds (The latter group was included to. assess the impact 


of observation on treatment effects.) The benchatl in the control group and ‘ 


inthe tréatmént-observed group (total observed N= 20) were seen. once a week 


ae Measures. ‘Classroom observation data were collected with a coding 
‘systen, that was ‘directly keyed to the instructional model. Students were 


between November and Mays a yee Sy et _ | a ae 5G > q 
‘i tested in May with the Metropolitan Achievement Tests, and their previous 
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Septenber Metropolitan Readiness Test. scores were used as -covariables. There. 


were no measures "of entering teacher characteristics. 

Results: implementation. In general, the createont Seanherid; had higher 
implementation scores than the control teachers. However, implementation by 
the treatment teachers was not consistent across the treatment components}. 
instead, those variables Shae were most specifically defined ta the treatment . 
were most easily feblenanted: by the, teachers (ecge, ered for salacting 
“students ‘to answer, giving simplifying feedback after errors). oh me 

Comparison of treatment and control groups also revealed that other 
differences were apparent; especially in the curriculum series used and in the 
amount $f — covered duttng che year (as measured by the number’ of basals 
mead) Some of the extraneous group differences ‘may be accounted - -for by | 
“dadixest. effects of treatment group membership (euch ‘as heighteried 
sepectationa for. producing student achievement, which eee to greater . 


content coverage), but these group differences cannot be accounted for by the’ 


specific suggestions in the treatment. Other group differences, such as the « ‘ 
~~ 


prindry basal reader head, probably | were related’ to ecto aeaterene which 

was confounded with treatnent group assignment. , a, 
Results: effects on achievement. There was a significant yitftereice 

favoring the ‘treatment groups on. adjusted achievement. Both ‘treatment groups 

_ (observed ioe unobserved) had higher mean adjusted reading, achievement scores. 

than the control group. There were no differences between the two ‘treatment 

_Btoups, indicating that. any treatment effect on achievement apparently was‘ not. 


moderated by” observation. ce 2 | oe ae 


Results: process-outcone relationships. Many. of the procese~outcone : 


relationships. were. those expected on the basis ‘of earlier research,,and 


‘ therefore many of the principles in the instructional fodel were substantiated 
| . Bh P & » i . : : ° 5 - . ; f : ‘ : 
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by the data in this study... In general, > those Processes that were associated 


with ‘reading achievement were also those for whieh: differences in 


{epienintatton were revealed. That is, treatment group teachers were indeed 


acting more in line with the treatment in ways that were related to greater. 
achievement. This suggests that the content of ‘the treatment was at least ; 


partly responsible for the treatment groups" superior achievement : scores. 


Conclusions. The treatment was related to chenEee: in treatment. teachers’ 


if 


Soheviors and to corresponding gains in achtevenent. However, data also 


revealed other Siseererees between the treatment and control groups that could . 7 | 
{ not: be closely . tied é the content of the treatment and which ates nay have: 


influenced achievement (such as amount of. “coppent covered). . é ; , - | 
Discussion we Folks, oe ‘ i | or BF 
7 In all three dushieds. changes in eteachers' behaviors and corresponding BS" . 
changes in- student achievenent followed’ ‘the application of a relatively. Tran agit 
treatment. (At least, the treatments were “piaple in terms of administration ) ‘ | 
The purposes of these fisid-banad. experinental studies were at least twofold: 
first,. to confirm eaesiee relationships. through an exparinantal doeten that 
allowed some EiaciGalens about canveality; and second, ‘to determine if 
suggestions based on descriptions of effective teaching are ‘eufficient to 
influence teachers' behaviors. ; | i . a ce os ee 4 a 
The second objective was fulfilled to some “extent An each study. es, on 7 


’ 


: Although none. of the’ treatments was coupletely implemented, each was utilized . 


The first objective, determining cette is harder to evdivate. In > bce 
the Missouri Mathematics Effectiveness Project and the Texas Firet-grade : | 
‘ | Reading Mronp Study. there was clear: replication: of: some earlier - ; 

. process-product relat fonehips suggesting that she content of the. treatment 


Cy 


in some way by the treatment teachers. - Bg es = é | 


> 


~ 


PRR eee are arias Se Er : 


y ‘\ 


contributed to the merase treatment effect. That ia, not only were the 


. treatment teachers acting more in line with. most parts ‘of ‘the treatment, but 


., the extent * to which: teachers did so was related to the degree of achievement 


gain. In the study conducted by the Stanford ‘Program for Teacher . 


* causing the associated effects, since, ¢ ‘as Cook and Campbell (1976) pointed 


, 
’ gtudies, where the treatment ‘teachers were behaving in ways that were 


“ content pacing and choice of materials) can not be, eliminated as a possible 


1 contributor to the treatment: sitacts Also, there ‘was no ‘control, for a 


* 


i 
to treatmént content fros ettecen iictace with menbershitp-in a treatment 


, -effects, because 27 schools were sampled. Kiber: though schools | were = fee unit 


of treatments with observed effects. ;Although ‘the: treatment teachers in rhe 


“associated with student gains. However, in the Texas study, the potential . 
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Effectiveness, there, was no strong evidence of ‘replication. of earlier ~ 
relationships, although there = effects that. were associated with the | 
treatment (e.gs, implementation of treatments. achievement gains). ‘This 


discrepency prevents simple conclusions about the content, of the ‘treatment | 


out, one necessary condition for causal inferénce is demonstrated covariance 


\ 


Stanford study were behaving in several ways specified by’ the.” treatment, there | 


were not strong relationships between those behaviors aa student achievement. 


’ 


(There were trends in the expected direction in some cases, but these seldon 
reached significance. ) , . 


Le 


Conclusions about causality ‘ave demain more reasonable in the. pbhet two 


«influences of Ree rastared ase on‘ some classroom processes (such’ as ham 
& ’ : -~ 3 P 7 . 


Hawthorne effect, and so there was no way to completely ‘aeparate effects due 


' 


group. a ” . . : i, 


. 


' The Missouri study, fs easier to. wekuste due to its design. there is” 


less ‘reason. to suspect ‘school-related factors: as contributogs es treatinent 


A aa | sigh Ta 


: ‘ 
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‘of t asbtgnaent a “this: fires. sie sured that random assignment ‘probably 


“distributed school-related factors across ‘treatment groups, The treatment: of 7 “te 
| ‘the! control: group and. ite associated achteveneht aati made it possible ‘to. ye : - 
es - demonstrate additional. effects. fue to “treatnet content. of ‘course, it is ot i 
=e ‘ posetbie to know ‘that the motivation of. the control group exactly. iatiched that : : 
ye “of the. tregtuent group.’ On the whole, however, the teaulte of the Missourt — . 

“ tudy otter the clearest evidence that student learning —_ were . indeed. 
ae caused, a least in part, by ‘the ‘content of the treatment. . eg - . 7 | 5 ; 
: Any’. field-based \experinent wilt be open to questions about. eeagel:. 

=a tnferences, since there is 86 way to adequately control all influential . 

| factors. — However. deoptte such questions, the: three studies aid. eotouphteh of 


naa i ar a“ 


=4 . important objectives.’ “Their overall Pattern oe is ahaa ta’ demonstrates the 


oh 


efficacy | of process-outcone ‘research in the elasetoon; and: the utility of 
o % a a e ‘ . oe 
ae experinesital studies that attempt to nodtty. teachers! behaviors while ps BS 
~ “~ " substsitiating earlier research findings. Such’ studies represent an ‘important. | 


a next, etep for researchers of teaching, aithough: there ate ‘several, issues that 


. imust be considered in their design if experinehtal: studies are to answer more : . 
s eo | “questions han: they raise. o © Be Oe Fs Pig ee ae 


« Mt 


4 


; . ae As noted in. the introducton, the dilemma facing. the classroca researcher 
‘e ar: e., fh nn hee a 
‘ ; who: wishes to conduct | experimental studies ‘ts: to Teach a compronisé mateeen 


d Sy 


iaeceetcoact asi and _re elevance, ‘The experimenter must, naintita "ecological, validtt 


a but ‘must’ :aleo maintain control of oF account for many of the factors that 


he aes affect teacher iohaviote and student outcome... The , experimenter must pursue 


eniaeniaaaemisaimieaatemnmaantnel Spear RINNE R Re sree EN NC Me Some Perecerety rib 5 wokebpor ee menenteengee 


| .¥# ’ the. ‘goal, -of objective research, whideaat ‘the same time recognizing: the 


mw AURG 
ee ‘complexities of classtoce life and modifying comnttments to measures and. 


ie é 
5 ‘ - designs that are more duitable for: more controllable condttfons, . 


” r 2 ” eof 
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been grouped under two headings? developing treatment content that maximizes, 


7 Stallings (Note 14) for other reflections’ on design. Many of the; ‘Problems and ero. 


’ wisely, then the experinent, no matter how well designed and conducted, vill = 


tg ‘the ‘selection ate. development of. treatnents. 


b 
| : 
q 


tte piace, te. repletion save. soe Shan eosin satsaban $0: 


‘understanding ‘and. knowledge of classroom life... ms 4 . ns c 


. : z ~~ % . . eg : ad 
ae ; * 2 . 5 ‘ if. : ae \ ‘ ‘ , % oi r 


om. 5 
Several suggestions we heat derived ra the three ‘studies is have ' 


‘the chance Hox: _ecolo icall ‘valid peetIee, “ maintaining exper iment 


_gontrol in order. ‘to isolate effects of. treatnent contents Many. of these ne 


suggestions are taken poe Brophy (Note. 13).. Also ‘see Cravford, Gagey and — 


, Suggestions exemplify mpplicatdon in a elassroom setting of iinet piss first | 


\ 
‘Fateed by Bracht and Glass, (1968), Campbell ‘and Stantey. (1963), Cook and 


Canpbei (1976), and Snow (1974). BOG we AT Pek Se 


Developing. Treatment Content that Maxinizes ‘the 2 Chance | 


; for Ecologically Valid Results. 
The ‘tiret step in ‘conducting. an experimental study “of teaching) 19 ¢ to 


| - : 4 


¢ 


decide on the content of. ebe, treatuent. tf the treatment is ‘not. chosen 


not produce educationally significant results. Yet, most ‘guidelines, « 


“Conduct ing educational experinents (such as Bracht & Glass, 19685" Campbell, & - 


Stanley; 1963; Cooke & Campbell, 1976) do: not devote bela if. any, attention to: ‘ 


= 
’ 
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" Developing. a Classroon treatment based on esearch requires that ‘the | 


experimenter te more than simply ‘Let research findings. A ‘translation’ must 


Tsai Onee \dergon.. The experimenter must organise the research ane ‘etructures 


and concepts that are meaningful | to teachers in classroons——that reflect their 
ai a lS aR See er te oe areetremanae neg erect h it fry es ae 


ner Ea rime rerrvaaioned dpe token in Renee mee RI AP EIA MPT WD TH 


; The three treatnents atecussed here shared. several characteristics that. 


increased their potential for successful Amplenentation and impact. First, 


é 


“the content | was ‘relevant to teachers, providing suggest ions for dealing. with He 


| 
i 


es ae See tore ae a 


Y 


already existing classroom demands. - Second,’ many rok the suggestions were. | 
specific. Third, many of tthe suggest ions were ‘orgentzed ‘into ‘clusters’ with aR 
rationales that: related them to important goals. care sah oe BR PSS oa és ‘ 4 
Selecting relevant content _ ae > 3 ioe e. s 2g “ a . a fe r oe 
The treatments. in the three s studies may be: viewed. as collections of 7 wi 0 : 
strategies ‘and. techniques: that | are applicable. to. ‘common deniands. of the: 
. classroom, ‘They reflected the complexity of the teachers" work sa that cack 
treatment was ‘presented ‘a8 a system of ‘instruction that was organized around | | 
several routine tasks of teaching. the pasts ‘eurrteulum Byer example, the 
pth 4 a. : Miesourt study enphasized presentation of . new. Anformation; ‘monitoring student 
- . "practice, and accounting for etodente’ works. ‘The Stanford study provided: = 
suggestions: for. behavior control, afranging students aia Anetruction, ina the se 
i questioning students during a discussion. The Texas study focused on 7 
group~management. ‘techniques and questioning and: feedback, etrategies. : ALL of eee: 
these categories of behaviors. describe the. tasks. of. all ‘teachers in ‘comparable . - 


vo | .. circumstances}. the treatments staply focused che teachers’ attention ‘on. the. | 
ee He ‘tasks and recommended ways of performing ‘them more efficiently ¢ or in a | more 

| goal-directed manner. ‘The teachers were ‘not asked to partons additgonal, or. _ 

unusual tasks. ' ogo aa , | ‘ 

- The ultimate goal - of ‘ach | ‘treatment’ was improved qcldawieenk in basic | 


kilde.thecdgh-taprovenent-of-datly-tnetructionnve.goal-that-1#-11ihsl 


~ shared by most ‘teacherp. | Therefore, the studies can be contrasted: with ‘others 


sentria da. whch. the soale may. not be _shared_by the. teacher (évges to: validate von] 
premise in. a ‘theoretical model). or that ‘require additional work by ‘the 


eeret examining ways of resenting the content of an experimental a | 
ai ly sefence rriculum)s =. | ae ee haa * ites a: as ae ae 4 
ie Fig : alae iY a 
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Teachers" responsibilities are vast, ied there is competition for: teacher. 4 ; 
attention and energy. (Doyle, 1977); »Jackson,_ 1968). The results of these. three 


studies indicate that research findings’ can: claim their share “of. teacher 


} 2 i attention when they represent ‘ ct Anfornation “that assists teachers in. 


_ fulfilling their mejor instruct ona goals. ee ‘nr as one : 
. This does hot mean: that i. chers will not change in nore drastic ways Fes a. < 
§ given appropriate. institutional supports. The point made here ie that simply 
providing relevant {formation to teachers, without providing additional 
‘support or renoving demands , waa sufficient to yield attferent, and presunably ~ 
bett@r, teaching. Some. probable reasong are ‘the: ptacticality of she. content” 
" and: the ease ‘of. incorporating it into a daily bia sad — ie) _ : a 
Specificity of Treatment “ = PW A§. . - Pa. | - ae "e 


In each study,” the. principles: in treatmenta ‘that were. ‘most clearly : 
implemented by the treatment groupe were. those that were most. ‘apecifically 


: def ined. That is, thay: were presented in behavioral terme—viiat he: teacher aod 


| 
| 
| ; | i 5 was to do. Principles that were less well tuplenented tended to be, more 
es 7 sage ae a higher level of abstraction ‘or. complexity, so that it. was Jess 
| -/ clear to the teachers exactly what behaviors were expected. (Of course, at 
a may also nave been the Nags that the measures were. ‘less tlaaely defined and 


' gubject to more error.) ‘ For example, insthe Missouri study, suggestions about 


pe ete a nn - 
treatment teachers. at a Magnet level than control. Eaacharss. “However, 
-- “—---- Recomendat ona for emphasising. meaning and underetanding sn. the.developeent, 


% portion of the lesson were ‘not implenented, by the treatment teachers. In. the 


" Stanford study, principles describing selection of students to _anewer. : 4 sau 
7 questions were well ieplenented, while principles describing the need to. 


e33 : Be accurately: target discipline corrections did. not lead to. higher levels of, 


‘ _ 
- : : ‘ ‘ . 
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appropriate teacher ‘baavioies: Tr the Texas: mtudy, treatment | ‘teachers 


ut 


“i implemented’ suggestions about selecting: studente and. giving feedback to’ thet Rae 


ers 


answers, but “they. ‘did not utilize Suggestions “about “using” ‘ptudents: as rae Ps 


models’ or ees the arias when: students revealed different rates of 


“Learning. . eG a , te = : 9 


+ 


“It can i concluded that the kind of treatment offered in these three < 
a studies thse ‘relatively minimal in terns: of efforts required to. present it. ms 
‘and learn it) will have its strongest Ampact ‘on teacher behaviors ‘that are e] 
clearly and imply described... ‘More e i ‘lex . teaching behaviors may. require “S . 
‘x eee more extensive, treatment than ‘was: she in these three studies. © ‘The: content 


and the savin: of pense a treatment are related; this: ‘point’ must: be 


. | ‘considered hed researchers who wish x provide treatnents. and assess their 


| 
=| 
re impact on behaviors: “2 : yr a A 
me. * _, These pointe are sseparatils to those iaads: Doyle é ana Ponder ain, who + 
= suggested that the _pemetsealtey’ ethic” determines whether or ot’ teachers 
| s wilt effectively use ddvice. REACESCEEEEY depends . on three qualities: Ps 
operationality (easity translated ore behavior); congrue nce. with the. 
teacher’ ‘8 own role definition; ‘and efficiency An terme ‘of. the: teacher’ 8. “cost i 
and time. These. three suggestions imply that a ‘treatment will. be tuplenented 
. most easily when it ‘ts specific in: terms. of routine teacher bettaviors,. and: : “| 
SER eran ity cent 
. teacher's goals of amsrridring the students. . Also, the behaviors’ “must: not 


"" 


‘wetness eventenstve-dédendy w the-tecchete-tine ‘and* energys-of-at~Least-none that" 4 


are. Rot compensated for n some way, vo BEM ES ae Hg a | 
; : ; i pity * : 
8 However, an requirtag hac a eeentnde be operational. and relevant in See. 
a zs, 


| terms of routine classroom tasks, a ' problem arises. “The treatment aat be ‘i : 


pacific. nough to allow translation ‘fate actual dehavior, but. there are ws 


inherent difficu ties yith very. specific advicé. Specific suggestions must be 


. imbedded. thin! larger. principles, since’ no fsolated behavior: can be - i; : _ 
, Meprapetas ¢ ali of ‘the tine. i ie not possible ‘or desirable ‘to. List all - 
"possible pene ions and: the variables defining appropriateness. Such an: a 
epprosch implies, that teachers. memorize avainciad ‘and: apply them - 
arbitrarily. | Pn ms ee ne ‘33 ens oe . 
‘ 4 more reasonable approach. ‘to treatment ‘design is to identify general. 
principles of effective {netruction and. to cluster specific etrategies under ; 
: each; The specific strategies then serve as yaeeypies of the larger principle . 
' 80 hat. teachers are provided with operational iueiaaie a ‘When treatments are ee 
cmnloted in this ways the. ‘suggestions. about : particular techniques are. 
imbedded in contexts aud supported by rationales that prevent “the treatment ‘ 
‘from’ appearing arbitrary and. inflexible. . , 
The use ‘of meaningful clusters was Present in sea of the three studies ae i 


reviewed here, although ‘they were ‘different in each study. In the Missouri - > 


. > ay : # ) 


study, sequence within the Legon was the basis of the tidstdent ‘components , a 
and objectives: for each part of the lesson were “presented as the guiding 
concepts, Since this study Represented a nearly complete treatment for a im 


particular setting, it was possible to use temporal Sequence as a consistent, 


. 


organizer. The Stanford study used three broad aspects of teaching to - Jodie. 8 


organize the specific suggestions: behavior ‘control and ‘management; ~ . a 
~—\~S—-~tnatructtonal-methods;~and”queetsoning” and-feedbacks~* fee we ett te 
the: ‘Stanford study ‘included only variables. from’ earlier ‘studies that yielded~ 
“etgnificant correlations, their clusters were primarily based on the variables ; . 
available. ia) the Texae-atody, a combination of eked abuponents (getting 


ae eee ses cs i 


; Ce re re 4 5 f 
- ae rape a 
Pies “43 attention, introducing: ‘the Jessen), and Geaching. tasks (calting 6 atudentsy 
i } _ Biving feedback) were used to. group the ‘variables. ar be Aa wn 


Bach’ treatment: mncluaed 1 some discussion of contextual feces S that - i 
oo " should be considered. when applying the principles. | In the Missouri math 


study, teachers were “urged, to. consider mbndens underatanding at various staged 


ts the Lesson, and to select ‘their, next. steps ‘according to: ‘that dt agnosie. In .. 

q _ the: Stanford study, teachers were ‘given. different guidelines for more. and less: | 
| academically oriented students. sa ‘the: Texas. study, lesgon pace and type of 

‘question were'to. be: ‘taken into account in. espqnding to atttexent, types of re 


“students answers. ~ 


t 
«4 


. ‘The purpose of presenting suggestions | within clusters cand with ‘contextual 

: # qualifications is to. help teachers choose auong alternative strategies : 
“according to a rationale that defines appropriateness. That is » the purpose = i 
of “treating” teachers is not. ‘to encourage thea to use a specific technique | 
every, time it. is possible, but instead ‘to ‘optimize use of; several techniques 

‘or strategies-using then when appropriate and avoiding their use when 5 3 


a _{nappropriate, Training teachers to, make: such oectetens requires a. conceptual. 


pes _ "framework vith which, they may examine their classroom tasks along with.a 
rationale that explains why certain specific. strategion are or are not 
effective in various. contexts. rer a p tos t 


e-tap tenttons-of thts for esatask“a TGS BFS enats pecttie i _n 


+ 


suggestions must be placed ‘within ‘a meaningful framework. This is an, 


oye 


movements ~-tuportant-part-of ‘meeting the-firet-ob jective of -elaseroon experimental ances a 


designs, maintaining: ecological validity. Teachers daily. make thousands of 
“decisions about their teaching tasks and _ no treatnuent, no matter how thorough, s 
is will ‘replace. the teacher's. use of or or her own _Sudgnent of what is best to 

_ do at any given moment. . He in a et he, 


Se L =~30-. ; i = 
é . i oo t 
4 « = 
’ : F 
* > . ne . . . ‘s 


oe OO ee ge ee fo ea eee eS ee ee ee oe ee ee ee a eo a a | es 


Re One ‘smportant ‘implication of ‘ghia for the ‘experimenter who, designs a | 
* . treatment is. that one must ‘often interpret beyond the date available from the ei 
= - original . sources, although caution - against _overinterpreting must. be observed. _ | 
' The original correlational reséarch has most likely . been reported in: perma of. 
variables: derived ven an observation instrunent. ‘The . experimenter must 
_ decide how. literally to prebent those. , Measures, and how’ much ARSED OP ORS BS: ts | 
reasonable in order to accurately, ‘depict the results. Results ‘must be 7 


considered as more than the specific measurements, and presented within ¢ a se ae 


context of. meaning that provides rationale and pitpddes: « That is, a measure of 
a behavior. in one ofeting does not translate directly into ‘recommendations for. 
i DRAcksce: in that setting or in any - “others Behaviors are meaningful only. when 
: Bae ; considered within a larger eontaxt. It is short-sighted. .to consider any - | 
| tehavtoe che is correlated with outcome as necessarily having a direct * —~ e | 
ae connection to joutcome,. whether causal or otherwise. In many cases, it is more. a8 
Likely that the behavior is part of a sequence ‘of events that. are all. 
sssoctated eit outcome, and anther : Recutecky event may have a auch wore 
mnerest connection’ to fhe outcome’ 11 as to other intermediate behaviors. 
This te is, of course, the rationale behind various statistical approaches 
to ‘grouping variables. The point nate: is. that it: must also be done on a- 


a 


conceptual, level. in defining, specific behaviors. to incorporate. in a treatment, + 


. even if some : intuitive leaps ‘must be. made. ; ceadig are many possible 


- toterpretations ‘of the functional meaning of any variable, and these . 7 me o 

> fakerpretatious™ affect th the. s presentation of results ina a ‘treatment. “The ) 
experimenter who is familiar. with classroom life and teachers’ mS - 8 P “ 
responsibilities rP iakety to te more successful at making valid and - realistic , 
interpretations han a ‘researcher who has: -not worked: extensively with eeathars 


and classroon data. . Bere Pip pe Et. ake 4 oe , oy > 


‘he an exanple, consider two alternatives ‘to presenting, the. findings ideal 
several studies that more ‘effective teachers (dees, whose students have higher te. 


“adjusted. achievenent) spend relatively m more: tine’ on academic content: and.” iy 


; neletively’ less. tine on procedural, organizational, and buhaviorad ‘matters, 


If" one ‘were to go - directly from: the: variable’ to the treatment; 5 ‘the gee a 


U 


ae . recomendation would be ea reduce time. spent in honacademic matters. "However, er 


n 


this, ignores the fact ‘that such. time allocation may well be an outcome of | 
other, more basic managerial practices. te stich, Eos auch, time spent . ‘on. 
' procedural wacters is a i daa ‘of other problems, id treating the ayanton 
iba not, directly. change the underlying causes. Therefore, one wight 7 a 
present the behavior as. an. indication of poor: t ie nanagenent vin suggestions 
‘4 _ os for direct tredtnent of the picbabie: carina: Of course, » this ts Likely ‘to. be yy f 
lene! data-based approach, probably requiring some. supplemental information, to 7 
data found i the correlational studies. The® experinenter's dilemma, then, Rs i 


ie juggling common-sense egal Femeka: with: objective data in creating a io 


ee ae 


treatment with a basic in earlier research that is also likely to be relevant ee 


. and iia to teachers. "&. ‘ , _ cag a Be. 9s 


oe 


Syst ‘ 
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"Another: way in which. "common-senge”. enters into ‘treatment development te ~~ 
a me oi , oe the recognition: that changes ‘in context or setting may change the 


appropriateness of a suggestion. For exemple, there are. times when 1 more 


: affective: -caachsts devote more tine,” relatively, to procedural: and 


é > ate < organizational matters, such as the. beginning of the school year or when 
as —— ~“Gnarodacing major orgeateatioaal changes | (Hamer, Evertenn,: & “Anderson, Note | 


4 eae 
15). ‘thvhowl the dimension that defines atfectivensss is "appropriateness, ‘ 


for a given et: of circumstances." Although one's correlational data source 
may ‘not yield these contextual distinctions, ‘the credibility of a treatuent’ a 
- os hence, the likelihood of SRC EAMSNEECECR? may. be enhanced by Ancluding. Bag ; : 
, ~32- ae 


. vgs 
’ A : Seen : > 
a ~ & 7 Car . 4 4 At ‘ era . 
Fs Bly ; i os é + : 3 oe ‘ 3 = 
oy * ar ‘ . Pog 
. ge + a , . : r , 
se 2 pe asth - @ « ano “e x . ord a 


‘eh 


q is : f 3 ne 
aa i & bs . ¢ wale Sek ST? & ue ee oO 7 = 
ae qualifications ‘that. ‘are’ pased en “common, sense and a knowledge of ae ar Ta 


ecology. oo 


Maintaint 3 


Ex erimei an’ Control” to Isolate Effects of | Treatment Content 2 

If sdesuate experi < control ‘is not maintained, | the daantin no - re . . 
matter: how bas csacetved and’ applied, cannot ‘be evaluated completely.” In the’ ~ ‘ sae 
traditional sense, ” frimental control” implies the elimination of ony . 


contaminating or. mSEET INE inf tusnces ‘by’ carefully matching groups on. all but "3 


— the independent variables or: by ‘systematically ‘varying other factors. Hence » ‘ ; . 
the — is the ‘only possible explanation for differences between — . “4 
, experimental and sone eet groups. It is obviously ‘not ee to” exert | 
control in this "sense in classroom studies, (since this Sed limit a - : = ‘ ie 
generalizability, ‘which usually has high priority). However, it is duportant 
to be able to isolate effects due to the Sraateant. and those due to other an 
factors that are unrelated or: indirectly Heleted to the treatnent content or : : : 
_ process. Control ‘an classroom ‘experinental studies may be exerted both | 
through initial _assigngent of Sideres to. treatment groups, and through icine 
‘measurement of classroom processes. | The latter may be used to statistically - * 
Se ee ‘control for some 2 factors, and may also ‘be ‘teed’ for’ descriptive purposes: to aid 
“ i ne in interpretation. dha’ purpose. of | such ongoing ‘measurement ‘ts to learn as. 


‘much as. possible about what’ hcirsiceas Me oceurred in the ¢lasstoons during the , 


stidys, 7 - tes OC > S., ee eae ; a cots 


“The. results of the three investigations ‘suggest several. ways. that | 


hirer eens tel ewe pretttt ahinrootre treme trttd son diatiancstide seth tviemitr optic Joprereneonterhiytatheseibarerer steer enzo nev atear ernment pace Al 
Po “ 


“eapersnaste! classroom” studies may be carefully monitored. =. of the ae 


@ 


cuggest ions involve choice of measures, while others ‘reflect. concerns with 


we x . > i . et a * 
"design, a Lo 4 . Code Sey. 4 a 
i. . Pi reid % . a* i - a} Ths - ' 
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i ‘Selects t and U ing “Measures: ‘ta Ex : rinent 


< determine -the effects of the treatnent on congpae and student behaviors: In. . 
particular, one inportant question is ‘how the, teacher’ changed. his. or her a a2 
Ss behaviors asa ‘result of ‘the. treatment. - Terefore, the observation instrument” 


used should be target€a £0 the ‘variables: of t Antereat——the. use (and 


the” resulting data will not adequately answer the questions about, the . . 

. treatment. This was one. problem SDE OMETAENE: by ‘the Stanford. experincntera, 
‘who selected as the: primary Anstrument. a ‘eyaten used. in one, of their four. 
source. studies. Variables from the other three studies could not. be. dearly 

, mapped < onto the Anstrument, so that parte, of the. ‘trgatment. derived from-those 
5 other atudies “emid not be evaluated coupletely.. The wana. ebady is an 
example “of use of a “content-referenced” coding systen, since it, was developed ” 


especially to test the typochease: raised dn that particular study. sey te 


used to gather sufficient information to evaluate tuplenentation 1 in both the 

ay natural use of “ Geoateent,prtacipis in  cottolglaases, « since the research, a : 
* ) on which the treatment is based was conducted in classrooms where: ‘teachers a 
vere using the skills. “In fact, te is quite possible that some. of ‘the: 
teachers in the control group wilh be “{mplementing” part of the treatment at - 


as high or higher a level than some. treatment teachers. Therefore, in order 


See ‘ . : . 
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Taplenentation measures. ‘One purpose of cht type. of mtedy is: to 


possible misusé) of. ‘the principles, in the treatment. When the. treatment ‘ts pie ts 


based primarily on ‘one ‘other study, "the observation. instrument used previously » 
may, be useful in: the treatment study. (as was ‘erve in the Missouri etudy). i. 


However, in most , cases, a new set. of claseroon measures must. be. developed or. 


ied 


. it Woe 
each elenent of the treatment. was clearly reflected in the. measures. ce 


“After choosing or developing a relevant set of measures,. they should be 


¢ * 


aa 


ty 2 - a : =34- . ts hi 
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Co 


to accur cate a assess. the effecté of treatment: content, it will be necessary to os 
a | separate, users from, non-users. Research on ‘the ‘Amplenentation process (Hatt: S : : 
, Loucks » 1977) has, demonsttated that an ‘educationai ‘innovation can: be most . . 
| effectively evaluated when. actual levels of use are considered rather than 7 ey 
arbitrary distinctions based .on treatment group a aa vga vot caw 
“Short-term outcomes. _ Adequate. measures “of. short-term outcomes (through 
i an observation system that allows recording of events in sequence) will allow 


the ‘experinenter to more. accurately assess the treatment effects in terns ‘of - 


. 5 
ie oe ale A 


routine classroom events Aevgs > student behavior following teacher | 
. “are ih « = 
‘corrections, avenny, answers: age teacher pap ie students’ emathnies ; 


in following a new procedure). Therefore, the ty criterion of 
_ effectiveness of - treatment does ‘not ‘have to be: ‘Limited ‘to -end-of-the-year : 
achievement aniiée. attitude. Even, if end-of-the-year measures are desirable, 
- eS inclusion of the short-term out comes will clarify causal connections between, 
ie the treatment variables and the eventual outcome. ‘Short-term ‘outcomes, may 
3 also make apparent any connect ions between the treatment a and outcomes that. - 
were not expected. 7 ' eo ees : a ie ay 
For acamsites in the Texas study, ‘the: _treatment suggested that eranettions | | 
could be made nore. ‘effective by using standard signals to notify the students. ma 
Most teachers, including control teachers, did this, and 80 there were no a | 
3 seep differences in saplesentation of that principle... Neither was there a - 
oe ee relationship with outcome due to the restricted variances (this dtd woe? | bees 


_rerttrereentbacem ie techn irene 


soe ecaneantenamanenearannamann antes nbherrsrelion iceetinmetichineebairrniiriniitatinatnimhY rie 


indicate that the Principle + was s Anyalid, hut that. it. represented a wery common, Sa 


behavior. ) However) there were differences between the. groups age measures a: 
eo 


» 


the efficiency ‘of transitions (with the treatment. group having shorter, 
senctiige ones). _Bince., there were no meARUERS of Preexisting differences, it 
“is possible ‘that the. treatment teachers had snoother transitions. to eegin . 


e . ‘$ 
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with ‘However, an iiternstive explanation is that the treatmen 


caused. ‘the teachers to ocd ¢ their transitions ‘and eon harder ° ‘make then i ae 


€ 


standard signals) were ‘obviously not" ones that ‘made a difference. ' However, 
“the short-tera outcome measure (effictency of . transitions) provided support 


for. an alternative explanation of | ‘treatment effects: {ncreasing. avareness, of *,. 


Om en e a problem area leads | to faptoved behavior, ‘regardless of specific” ra 


ie 


more effictent, even though the strategies stven in the treatment, (tees _ - a 
"suggestions. ty eh Oe Seat eS a ee se e ua | 


r ae . * ‘ 
Pretreatment measures ‘of © ere processes: ‘Before the "treatment ie hate 1 


_Bdnintetered, thete should ‘be sone measures taken of ‘classroom processes ‘chat oite 


¢ 


_ are expected to change over time due to the treatuent. eceaie: teasures: 


should be taken in ‘both control and treatuent classrooms. ; | scores ‘may . 


- + 


‘then be used as ‘baseline, measures! in order to. i cihin changes as a “result of es 


° 


ad Me, ae 
: the prvatment, and to demonstrate how comparable the treatment and ‘control ue a3 


ton * 
ee 


groups were intially. Depending on the research piste aa ‘pretreatuent 
measures ‘eoutd be used to assign teachers to’ conditions, 46 it’ were’ ‘desirable 


to ‘have treatment | and control groups “Antétally comparable on ‘some ‘Process: af ves 


. measures. For exanple, a study aimed at improving teachers! elassroon, . oe 


management strategies might initally draw a sample of teachers at ea oF raaras 


evele_of proficiency, rengting from ssachers_who_ate_already_exceltent Sete 


" managers to teachers who need a few ouggestions ‘in a ‘few areas, to. teachers. 


who need to 2 anerove - in Ege ways. Depending on t! the. purpose | of the study, th the 


mac aig het name tort ee ae bert Sap mls en egerrbti 


‘enferineaters could use "baseline information, ,to form matched treatment groups, 


~ 


or. es ‘eliminate some ceachers fiod the subject pool 80. ‘that the study included - 
- £ ee only one level, of ae roficiency. 3 ee Saas : ae os - . hake 
mo o ~ ‘The stanford study a only: one of the three to include ‘pretreatuent.. 
measures, and eho: it was possible to examine. treatment effects” over time, and te . 


fe ee Oe ee ee ee 


; other two studies had to rely on. Gouparisons of arous means, without kno 
zai assignnent Prevents major differences, but. because schools. were” _ : : 


ant heitha by achoal acabejshtn,? especially si the ‘Texas _skudy, were . 


‘observations. were made, ‘ta ‘oath six ‘schools. 


ta’ the: analyses of treatment effects, » OF to use to. balance expe 
ow: the beginning. ‘The list possible OER ‘Le infinite, and ‘the - 


. choice of measures ‘to be taken in any. pat deular study is a function of | ‘the 


= student ch characteristics s may also | be » Amportant,, such. as _motivations 


structuredness were important predictors of later behaviors; > unfortunately, pee thee, 


to: denonstrate several differences between the treatment at control groups : ue 
before tthe treatment. ati baseline ‘measures. as. a ‘covariate ‘in comparisons . ; et 


of the , groups, prevented gome, fdisa conclusions about treatment. effect. The 


tes 


~ 


how many differences were present ‘before the treatment, One must: assume ‘aise A Ps 


unit of assignnent, sroup ‘means on ‘classroom process measures may have: zen ‘ 
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Pretreatment measures of teacher Student » and school. characteristics. 


In addition to neasuring cléssroon. processes that will. be used. ‘to evaluate ies. a a 


treatment effect, “tt: _would be. wise to obtain other Pretreat a 
. yi 4: mo 
teacher, ‘student, ‘school characteristics, to be used. ef cher as ‘cova tates ro 


“ 


“Fesearch: questions. However, some general: types ofvmeasures will ‘1ikely be: : se a: 


, appropriate: in almost’ any atudys Student entering achievement, should probably, ie ot 


be used as’ one way of balancing. sroups, as was done dn. the ‘Stanford study. - Tf. a 


|_.__.__thte 4a not. ponnthle,.shen entering achtevenent should. be obtained. eed. $8.-— mn 


analyses: ‘of treataent effects, as was done in all three studies. Other Set g OO a 


. ve ts 
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Teacher characteristics were ‘measured in. two, of. the studfes, pe were os 


shown to interact with or affect the. inf]yence of the ‘eeeataents vIn the; ee oe ie 


“Stanford orate teacher verbal fluency and Pretreatneiit attitudes ‘toward... aan “ 


» now 
" 7 ~ 


‘these werd confounded with’ treatment ‘group menbership, + and the treatment - , i 


we ody 7 : : ag” 5 Pt 
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‘effect could not. be congletely scpatated from pay, ‘mis suggests: the 
4 yaw 
“importance of measuring. teacher: avtieudes and characteristics that” may 


_& influence ‘teachers! ‘receptiveness to a. ‘treatment’ hoes at As ‘easier. to 
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Or 4 
whee 


“a 
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fiat “smplenent: principles that are in accordance with one's own: -vatvas and ee 
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Fae 


* bette}. . “the Missourt, Math ‘Study data. supported, thts wy Hlataang- coiaplex: 
- dnteracetode, between teacher’ types, ‘student: types, and. ‘troatneng: group 
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the cpatinenta chooses to make. ‘treatnent seetgumenté withtd “chose. . Even 


: by ond q ra 2 
si ye rie ets: “poseibile to “have ‘onty, ‘ou ‘teacher per sends tavalyed t 
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- still factote related to the ‘achool “environment ‘that ‘ohould be considered. 
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For: ‘example s- in many schools where. ceachers team tor ‘Asetruction in’ ‘some 
subjects, the: amount of ‘time and. the pace’ at which the curtieulua is: ‘covered 


ts deterained wy achool policies. Instructional. esources,: ‘both matertal “and. 


at 


human, wilt vary’ from school ‘to school.’ ‘ALL. of these factors may ‘affect | the, 


pas ‘ 


“quality of instruction, received ty the students, and my obectie effects’ = 
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the: treatment.” 


In ‘addttton: to ‘measuring. 


yosee i 
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me 


ioe we 


process. variables that ‘deacustrate “use of the: treataeat tand other’ factors that’. me 


may: moderate ‘the. etfecte of ‘the ‘treatuent; ; “the experteenter should. leo oe, ewe 
- coy a, 2 ate wt A 
: aesatre as ) Many other ee aid setting characteristics as. posetbles 3 a8 
», Megitless to” say, this, nunber, will ‘be’ liatted, of. practical ‘Wacecsity. ae | pir 
ae ~f fe ed ¢ 
- ., Prottbly the ost, af, desirable type of. additional inféruatiod would te a few eon 
Ta geet i * de 
i a .. stances. of rich desertpeyons that include ochew aepécte of ‘thie classroom vand ee 
* other. “teacher and ‘student. behaviors ‘than those Pestana on tnthe treatment. ae 
Veing such descriptive thformatto, “ae: would-be. posesie to « exanine the 
; we ASE we 
; ‘freatnent wartables. in context. : Quaeteative, low-infetence. coding systens ” as) 
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& a + a often decontextualize variables ‘ia, order to compare them, across several E 


i 
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t ; it a rag, aE se 
ore nr ‘chsserocas.. “This te ‘necessary, “of course,. for some analyses,” but when a Tag Ri gE 


| ge ge : unexpected: results arise,, fe. is often. ‘difficult to evaluate ‘them with only 


Pes a LBs: . eo 2 4 oy ny i i 
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b- : r roe 
as . ox. 4 Soded. Aatan “de an-example of. how-such descriptive aes could: have cadded to eo NG a 
| a a the tnfornation provided by an ‘experimental etudy,, constr the Stanford ee Da bat 


ke = _stiy' * variable-of - “téacher movenent." “on the, Stanford treatnent,, teachers | 


jew tears sero ey . MS a dive 
ae * ® ¥., aus ah fens i . ; 


“were e-arged to. move around the ‘room. a lot. in order. uf monster. better. thie, 7 c a _ 
ae i ah ae “ coos Oe 4 at @ a ar 


- noveent te schtevnents Jaen tibie procese-prbduct correlations | were Pe 
wt iad, 2 3 ae ‘ pie! i 
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‘ps % omputei for’ the Sample. rey the’ Stanford study, there ie a. ‘atgnifiicant A he 


eek 


“negative cortelation with achievement. ‘This could have, been due to. chance nie F ia 


vartation, but another possible explanation presents ‘Ateelt : although 4k. = nn #: 


me 
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cannot be confirmed, Several of the schools in. the: study = involved ‘tn a 


” 


$ ‘ setatersupported progran ‘that: ‘encouraged, individualized, aseignieante. and ars so 
enali-group work. "te ‘ts possible that this represented. a. ma jor. pees for a 


he many of thie teachera, if they were. accustomed to more. traditional” ee . 
Sg aie i re A 


’ instructional patterns. Teacher movement in the context. of an unfamiliar bs - 


Anstructional fornat may well Fepresent . a different: functional ‘behavior, oll iui. 


movenent, in a ‘fantLiar format. Ina new situation, novenent. might: represent, he 2 of 


4 i 


lack: of organization, “and, excessive motion in order to, keep up with’ “what ts! * 


~ going on in the met. that is, the . teacher may, be pulled about, 80 ches. ‘che, 7 2 


“<< 


a movenent is more a. reaction to immediate needs ‘thas it al a planned ‘approach © a ag 
to: monitoring. Within a more foniliar POSStOE, teacher: movement might . 
— represent purposeful ionttoring, se. that ‘movement is. appropriate: to anger Pe 


instructional, goals. However. a etandardize d measure of. teacher maemane 


might. well. ‘obscure the dimension of goal-d lire pct If enough teachers’ ‘in * 


a catt + Messy 


teed the Stanford study were. actually engaged” in. less appropriate movement due to 
A are Rp a he oe on . ies ew eee 


im oe oS Nes Sev demande, ‘then. te is not’ ourpetsing that a ja negative "corredatton with ae ee . 
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"achtevenent was’ obtained. ‘In the earlier: studies: sovenent: at ght nave been, s ~~ F 
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